- Head of Research Group: Dr. Kristóf KARACS
- Members of the Group: Dr. Anna GELENCSÉR-HORVÁTH, András Attila SULYOK, Márton JUSZTIN, Péter HALÁSZ, Bálint LASSÚ, Andrei KONDAKOV, Boglárka SZABÓ
- Contact: karacs@itk.ppke.hu
- The center, which was founded together with Semmelweis University, aims to help perceiving visual information for visually impaired patients and to improve their quality of life by using medical devices and innovative technology, as well as developing new diagnostic and therapeutic procedures for eye diseases.
- At the basic research level our lab focuses on modelling spatio-temporal event interpretation, including vision, the sensory channel that conveys most information for humans. Here we draw inspiration from the operation observed in human vision, but we also work on building stand-alone models aligned with the capabilities of available and soon to be available hardware.
- A key principle we have developed is semantic embedding, which refers to the way information of different levels of abstraction, coming from sensors and a priori knowledge, make a contribution to the hierarchical recognition process at the appropriate level. We also develop representations and learning models for learning in partially observable environments. Our most important project is development of the LetSee mobile app for visually imparied people that helps them in everyday tasks requiring vision.
Obstacle avoidance by PPKE pilot using a phone based visual assistant developed in the lab in the "Sidewalk" task of the Cybathlon Challenge 2023
